CmnRec: Sequential Recommendations With Chunk-Accelerated Memory Network
نویسندگان
چکیده
Recently, Memory-based Neural Recommenders (MNR) have demonstrated superior predictive accuracy in the task of sequential recommendations, particularly for modeling long-term item dependencies. However, typical MNR requires complex memory access operations, i.e., both writing and reading via a controller (e.g., RNN) at every time step. Those frequent operations will dramatically increase network training time, resulting difficulty being deployed on industrial-scale recommender systems. In this paper, we present novel general Chunk framework to accelerate significantly. Specifically, our divides proximal information units into chunks, performs certain steps, whereby number can be greatly reduced. We investigate two ways implement effective chunking, PEriodic Chunk (PEC) Time-Sensitive (TSC), preserve recover important recurrent signals sequence. Since chunk-accelerated models take account more than that from single timestep, it alleviate influence noise user-item interaction sequence large extent, thus improve stability MNR. way, proposed chunk mechanism lead not only faster prediction, but even slightly better results. The experimental results three real-world datasets (weishi, ml-10M ml-latest) show notably reduces running with up 7x & 10x inference MNR, meantime achieves competitive performance.
منابع مشابه
Sequential Detection with Limited Memory
Sequential tests outperform fixed sample size tests by requiring fewer samples on average to achieve the same level of error performance. The Sequential Probability Ratio Test (SPRT) has been suggested by Wald [1] for sequential binary hypothesis testing problems. SPRT recursively calculates the likelihood of an observed data stream and requires this likelihood to be stored in memory between sa...
متن کاملMemory Fusion Network for Multi-view Sequential Learning
Multi-view sequential learning is a fundamental problem in machine learning dealing with multi-view sequences. In a multi-view sequence, there exists two forms of interactions between different views: view-specific interactions and crossview interactions. In this paper, we present a new neural architecture for multi-view sequential learning called the Memory Fusion Network (MFN) that explicitly...
متن کاملInfants use temporal regularities to chunk objects in memory.
Infants, like adults, can maintain only a few items in working memory, but can overcome this limit by creating more efficient representations, or "chunks." Previous research shows that infants can form chunks using shared features or spatial proximity between objects. Here we asked whether infants also can create chunked representations using regularities that unfold over time. Thirteen-month o...
متن کاملChunk: A Framework for Modular Distributed Shared Memory Systems
We present Chunk, a framework for building modular distributed shared memory systems for UNIX. Chunk allows applications that are designed to share local memory through the UNIX memory mapped file mechanism (mmap) to be able to share memory across different physical hosts without modifications. Chunk’s modular architecture enables the use of a variety of memory-sharing policies. We present a DS...
متن کاملAccelerated Attributed Network Embedding
Network embedding is to learn low-dimensional vector representations for nodes in a network. It has shown to be effective in a variety of tasks such as node classification and link prediction. While embedding algorithms on pure networks have been intensively studied, in many real-world applications, nodes are often accompanied with a rich set of attributes or features, aka attributed networks. ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Knowledge and Data Engineering
سال: 2023
ISSN: ['1558-2191', '1041-4347', '2326-3865']
DOI: https://doi.org/10.1109/tkde.2022.3141102